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A new object of the probability theory, the two-sided chain of symbols (introduced in 
Ref. arXiv:physics/0306170) is used to study isotropy properties of binary multi-step Markov chains 
with the long-range correlations. Established statistical correspondence between the Markov chains 
and certain two-sided sequences allows us to prove the isotropy properties of three classes of the 
Markov chains. One of them is the important class of weakly correlated additive Markov chains, 
which turned out to be equivalent to the additive two-sided sequences. 
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I. INTRODUCTION 



The problem of long-range correlated random symbolic systems (LRCS) has been under study for a long time in 



many areas of contemporary physics [1-6], biology [7-12], economics [8, 13, 14], linguistics [15-19], etc. 



■ Among the ways to get a correct insight into the nature of correlations of complex dynamic systems, the use of 
the multi-step Markov chains is one of the most important because it allows constructing a random sequence with 
the prescribed correlated properties in the most natural way. The A-step Markov chains are characterized by the 
conditional probability that each symbol of the sequence takes on some definite value depending on N previous 
symbols. These chains can be easily constructed by sequential generation using the prescribed conditional probability 
function. The binary correlation functions of the Markov chains can be explicitly calculated in some simple cases. 
The concept of additive chains turned out to be very useful because it is possibile to evaluate the binary correlation 
function of the chain via the memory function (see for the details Refs. [20-22]). 
' Another important reason for the study of Markov chains is their application to the various physical objects [23- 
J> . 25], e.g., to the Ising chains of classical spins. The problem of thermodynamical description of the Ising chains with 
' long-range spin interaction is open even for the ID case. However, the association of such systems with the Markov 
, chains can shed light on the non-extensive thermodynamics of the LRCS. 

The LRCS can also be modeled by another class of correlated sequences, the so-called two-sided chains introduced 
in Sec. II. They are characterized by the conditional probability that each symbol of the sequence takes on the definite 
value depending on the neighboring symbols at both sides of the considered symbol. An example of systems with such 
a property is the above-mentioned Ising chain. In Ref. [26] , we proved that the two-sided sequences were statistically 
equivalent to the Markov chains. In this paper this equivalence is used to study the isotropy properties of the Markov 
chains. 

The paper is organized as follows. In the first Section, we give the definitions of the Markov and two-sided chains 
and formulate the problem of this study. The next Section is devoted to the examination of the anisotropy properties 
of three classes of Markov chains: (a) the class of Markov chains that are equivalent to the two-sided sequences with 
Oh symmetric conditional probability function; (b) the Markov chains with permutative conditional probability function; 
(c) the additive Markov chains, which are shown to be equivalent to the additive two-sided sequences. 

• i-H , 

H II. GENERAL DEFINITIONS 

_ . i 

Let us determine the N-step Markov chain. This is a sequence of random symbols, a,i, i G Z = 
{...,—2,-1,0,1,2,...}, possessing the following property: the probability of symbol aj to have a certain value, 
under the condition that the values of all previous symbols are fixed, depends on the values of N previous symbols 
only, 

P(a.i = a\ . . . , ai-2, <H-i) = Pjv(a* = a\a^ N , . . . , dj-2, Oi-i). (1) 
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The Markov chain is a homogeneous sequence, because the conditional probability Eq. (1) does not depend explicitly 
on i, i.e., is independent of the position of symbols (ii-Ni ■ ■ ■ ■, a i-i> &i m the chain. It only depends on the values of 
ai_/v, . . . , di-i, cii and their positional relationship. 

An important class of the random sequences is the binary chains where each symbol a, can take on only two values, 
say, and 1. 

A very important subclass of the Markov chains is the additive binary ones. The conditional probability functions 
for these chains are described by the following formula: 

JV 

P N {a,i = 1K-jv, • • • ,oii-2,ai-i) = a + ^F(r)(ai_ r - a). (2) 

Here F(r), r = 1, . . . , N, is the memory function and a is the average number of unities in the sequence (see, e.g., 
Rcf. [21]). 

A permutative binary vV-step Markov chain is determined by the conditional probability that is independent of the 
order of symbols within the memory length N and depends on the number of unities among them only. 

We define an isotropic chain as a sequence for which the probability of an arbitrary set of L sequential symbols 
occurring, referred to as the L-word, does not depend on the direction of "reading" the symbols. For example, the 
probabilities of 5-words 01100 and 00110 occurring are equal. 

In different mathematical and physical problems, we are confronted with the sequences for which the conditional 
probability of symbol a% to have a certain value depends on values of N previous and N next symbols only, 

P(a,i = a\ . . . , ai_2, fflj-i, a%+2, • • •) = 

= -P2,jv(ai = a\di-N, ■ ■ ■ , Oj_i, aj+i, . . . , a i+ jy). (3) 

We refer to these chains as N -two-sided sequences. One can define additive binary two-sided chains similarly to the 
Markov ones, 

JV 

P2,N{di = l\ai- N ,...,ai-i,a i+ i,...,a i+N ) = a+ ^ G(r)(a i+r - a). (4) 

r=-JV 

Here G(r), r = ±1, . . . , ±iV, is the memory function of the two-sided chain. For the same reason as above, see Eq. (1), 
this chain is homogeneous. 

In paper [26], the equivalence of the two-sided and the Markov chains was proved. We have derived the equation 
describing the correspondence between their conditional probabilities, 

JV 

II PN{a i+r \Tr +r ) 

r=0 

P2, N ( ai = l\Tr,T+) = — ^ . (5) 

I] P N (a l+r \Tr +r ) + J] P N {a i+r \Tr +r ) 

r=0 r=0 
a i = l a i= Q 

Here TJ = (aj-N, . . . , aj-i) and = (oj+i, . . . , aj + pf) are the previous and the following jY-words with respect to 
symbol aj. 

Thus, any Markov chain can be characterized not only by the conditional probability Pjv(ai = a\T~), but by the 
two-sided conditional probability function, P2,jv(aj = a \T[~ ,T+), as well. 

III. ISOTROPY OF THE MARKOV CHAINS 

A. Two-sided chains with symmetric probability function 

The definition of isotropic iV-step Markov chain given in Sec. II is equivalent to the following statement: the Markov 
chain is isotropic if its two-sided conditional probability function is symmetrical, 



P 2 . N ( ai = a\T-,T+) = P 2 . N {a t = a|T+,T"). 



(6) 
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Here T~ and T + are the previous and the following TV-words with respect to symbol a. The subscript indicates 
that word T is read in the direct order, from left to right, and the subscript "<_" shows that word T is read in the 
inverse order. For example, if the binary 3-two-sided chain is isotropic, then 

P 2 , 3 (a 4 = 1|011,001) = P 2 ,3(a* = 1|100, 110). 

Equation (6) can serve as the second definition of the isotropy for the Markov chains. 

Below we prove the equivalence of these two definitions of the isotropy. This equivalence is the main result of our 
paper. 

Suppose that the first definition is valid and, therefore, the probability P{T~,a,j = a, T+) of an arbitrary (2iV + 1)- 
word occurring in the Markov chain is independent of the direction in which it is read. Then, the formula for two-sided 
probabilities can be rewritten as 

b b 

Thus, the two-sided conditional probability function of the Markov chain is symmetrical and the chain is isotropic in 
accordance with the second definition. 

Now, let us suppose that the second definition of the isotropy is valid, i.e., the two-sided probability of the Markov 
chain is symmetrical. 

Then, this chain, being read in the direct and inverse orders, is statistically identical. 

In other words, the probability of symbol dj = a occurring under condition that previous TV-word TL> is fixed is 
equal to that of the same symbol occurring under the condition that the following iV-word T<_ is fixed. It means that 
the original chain and its copy written in the inverse order have the same Markov conditional probabilities. However, 
the probabilities of words of arbitrary length L are determined completely by the conditional probabilities. Hence, 
these probabilities are the same for both chains. 

Thus, the probability of an arbitrary word of length L occurring does not depend on the direction in which it is 
read. 

According to Eq. (5) this chain, being read in the direct and inverse orders, has the same Markov conditional prob- 
abilities. However, the probabilities of words of arbitrary length L are fully governed by the conditional probabilities. 
Hence, this chain is isotropic according the first definition. 

In the general case, the Markov chains are anisotropic. Nevertheless, our analysis of Eq. (5) shows that all 1-step 
and 2-step additive Markov chains are isotropic. All non-biased 3-step additive Markov chains are also isotropic. 
The additive chains can be anisotropic for A ^ 3. The 3-step biased Markov chains with conditional probability 

3 

P(di = l|oi_ 3 ,ai_2,a»-i) = a + ^/ r (aj_ r - a) (7) 

r=l 

and a ^ 1/2 are isotropic in three exceptional cases only: 

1. fi = ,f2- This condition is fulfilled, e.g., for the chains with the step-wise memory function. 

2. fi + / 2 + / 3 = 1. It is the degenerated case. This memory function determines the Markov chain consisting 
completely of unities or zeroes, since = 1| 111) = P(di = 0|000) = 1. 

3. /3 = 0. Actually, it is the 2-step additive Markov chain. 

All additive Markov chains with small memory functions, F(r) oc e <C 1, are isotropic in the main approximation 
with respect to s. This fact will be clarified in Subsec. Ill CI. 

It should be noted that the two-sided chain with asymmetrical conditional probability function can be considered 
as the Markov chain being read in the direct order and as another Markov chain being read in the inverse order. The 
conditional probability functions of these chains are different. From the foregoing two conclusions can be made: 

1. There are, at least, two different asymmetrical A-steps Markov chains with equal correlation functions, 



K(r) = (oj - a)(a i+r - a). (8) 

2. The additive anisotropic Markov chain being read in the inverse order is the non- additive Markov chain. Other- 
wise we would have two additive Markov chains with different memory functions having the same correlation function. 
But as shown in Ref. [22] it is not feasible. 
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B. Permutative Markov chains 

1. Isotropy of permutative Markov chains 

Here we prove that the permutative binary iV-step Markov chain is isotropic. Let us consider two chains, M and 
M', where M is the given Markov chain, {ai}, and M' is the chain written in the inverse order, {a-}, a- = a_j. We 

refer to P k, or P(ai = l\T(k)) = P(l|T(fc)), as the probability of symbol aj in chain M to be equal to unity given the 
previous TV- word T(k) contains k unities. The probability of the TV- word occurring satisfies the set of linear equations, 

P(a 1 ,a 2 , ■ ■ -,a N ) = £ P(a N \a ,a 1 , . . . ,a N _ 1 )P(a ,a 1 , . . . ,ajv-i), 

a ° (9) 
E---E p ( a i> a 2,--- ; aw) = 1. 

a± aw 

The probability P(a\, a 2 , ■ ■ ■ , ajv) of iV-word occurring is determined uniquely by Eq. (9). The solution of this set of 
equations depends on the total number k = a\ + a 2 + . . . + a N of the unities in the iV-word (a x ,a 2 , . . . ,a N ) and can 
be presented in the form P(a\, a 2 , . . . , oat) = P/.. One can easily find the following expression for Pk, 

P k=Po f[l^. 

We also refer to P(1\T) as the probability of symbol a[ to be equal to unity under condition that the previous 
iV-word in chain M', T, is fixed. Now let us prove that the conditional probability functions of chains M and M' 
are equal to each other. In other words, P(1\T) equals to P k for arbitrary A^-word T containing exactly k unities 
(k = 1, . . . , N) and is not dependent on the order of symbols in this word. With this purpose in mind one needs to 
prove that 

P(l|[fc],0)= P(l|[fc-l],l) = P k . 

Here [j] means (N — l)-word containing exactly j unities, so that (1, [k— 1]) and ([k— 1], 1) are the TV-words containing 
k unities. Using the definition of the conditional probability we find: 

p(Hlk - i], i) = pm - i], = PMk = _ i]j = j3 t , 

? (1 | W ,„ ) = ™) = (1 _P (+l) ft±l. 

From set (9), one gets the relation 

Pk+i = Pk+iPk+i + PkPk- 

So, we have proved that 

P(l|[fc-l],l)=P(l|[fc],0) = P fc . 

Thus we can refer to P k as the probability of symbol in chain M' to be equal to unity under condition that the 
previous A^-word containing exactly k unities is fixed, and the conditional probability functions for the chains M and 
M' are equal to each other, 

P k = Pk, k^l. (10) 

Hence, 

Po=Po (11) 

since 

£ P(l\T)P(T) = ]T P(1\T)P(T) = 1. 

T T 

Equations (10) and (11) do imply that the permutative binary iV-step Markov chains are isotropic. 
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2. Two-sided probability functions of permutative Markov chains 

As was mentioned above (see Eq. (5)), every Markov chain can be regarded as two-sided one. Below we examine 
the properties of the two-sided conditional probability function of the Markov chains with one-sided conditional 
probability functions possessing the property of permutability. An essential point is that this property does not 
provide the permutability of the two-sided conditional probability function. To demonstrate this fact we will show 
that in the general case the two-sided conditional probability function changes its value when two neighboring symbols 
1 and are transposed. 

Let us prove this statement by contradiction and suppose that the two-sided conditional probability function 
P(ai = l|Tp, T+) takes on the same value for two variants of the word . These variants of the word T~ only differ 
in the values of the neighboring symbols aj and cij+i: aj = l,Oj+i = in the first variant and aj = 0, <Zj+i = 1 in 
the second one. Consider the structure of Eq. (5) . Taking into account the permutability of the Markov conditional 
probability function one can see that A factors in all products in Eq. (5) coincide for two symbols sets under study. 
In the general case, only one factor, Pjv(oj+jv+i|7j+jv+i)> cnan g es hs value. If dj+jv+i = 1, the coincidence of the 
values of P(<Zj = 1\T^,T+) for two sets of symbols under the consideration yields the following relation between the 
values of one-sided conditional probability function: 

Pl = P k+ iP k -i (12) 
for k = aj +2 + dj + 3 . . . + a,j + N, 1 < k ^ N — 1. In the opposite case, at Oj+jv+i = 0, the similar requirement is 

(l-P fe ) 2 = (l-P fe+ i)(l-P fc _i). (13) 

These two relations are compatible for the non-correlated chain only where Pj. is fc-independcnt. The exception is 
the case of one-step binary Markov chain that always has permutative two-sided conditional probability function. 

Thus, any correlated multi-step permutative Markov chain possesses the non-permutative two-sided probability 
function. 



C. Additive weakly correlated Markov chains 

The third class of the isotropic sequences represents the additive weakly correlated Markov chains. For these chains, 
we suppose that the memory function is small, 

N 

£|PMI«1- (14) 

r=l 

Their asymptotical isotropy is proved in Subsection III CI. 

Every function of N variables, f(a\, . . . , ajv), satisfying the evident restriction, ^ f(ai, ■ ■ ■ , a/v) ^ 1, can be 
thought of the conditional probability function P(aj = l|aj_jv, • • ■ , a-i-2, a-i-i) of some Markov chain. Yet not every 
function of 2 A variables, even if restricted by the similar condition, is the conditional probability function of some two- 
sided chain. It follows from Eq. (5), that an arbitrary binary Markov chain is determined by 2 N parameters, i.e. the 
number of all possible sets of arguments in the conditional probability function. Hence, a two-sided chain equivalent to 
this Markov one, is also determined by 2 N parameters. Nevertheless, the two-sided conditional probability function 
P(di = l\T^~,Tj~) is formally governed by 2 2N parameters, i.e. the number of all possible previous, Tr, and 
following, T- + , A- words. So, not every function of 2 A arguments can play a role of some two-sided conditional 
probability function. The example is an additive two-sided chain with small memory function G(r) in Eq. (4). In this 
case, G(r) has to be asymptotically even. This fact is proven in the Subsection IIIC2. 

1. Isotropy of additive weakly correlated Markov chains 

In order to find the conditional probability function, P(aj = l|T i _ ,T i + ), of the weakly correlated additive Markov 
chain one has to substitute the probability Eq. (2) into Eq. (5), and retain the terms of the zeroth and first orders in 
F(r). The obtained two-sided conditional probability function takes the form of Eq. (4) with even memory function: 
G(r) = G(—r) = F{r). So, the additive weakly correlated Markov chains are asymptotically isotropic. 
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2. Restriction on the class of the memory functions of weakly correlated additive two-sided chains 

In this subsection, we show that the weakly correlated additive two-sided chain is asymptotically isotropic, i.e. the 
two-sided memory function G(r) is necessarily even. To this end we consider arbitrary two-sided additive chain and 
find its one-sided conditional probability function, P{a,i = l|T-~). We will prove that this function is reduced to the 
additive form, Eq. (2), with the memory function F(r) = G(—r), and, therefore, the chain under consideration is 
asymptotically isotropic. 

Let us examine the additive two-sided chain (not obligatory isotropic) and find its one-sided conditional probability 
function. In the general case the problem is reduced to solving the set of 2 N non- linear equations, Eq. (5), written 
for different sequences of symbols in word T~ . We consider weakly correlated additive two-sided chain subjected to 

iV 

the restriction ( | C( — ^) | + |G(r) |) <C 1. Its one-sided conditional probability function can be presented in more 

r=l 

convenient form: 

P(ai\Tr) = 1 - a, + (2a, - l)(o+ f(Tr)), (15) 

with function ip(T~) to be determined. The evident equation P(a.j = 1|TJ~) = 1 — P(cii = 0|TV~) is fulfilled for 
Eq. (15). If G(r) tends to zero, the probability P(cii = l\T^) goes to a and function ip tends to zero: tp(T^~) — > 0. 
Now, substituting the conditional probability function in the form of Eq. (15) into Eq. (5) and retaining only terms of 
the zeroth and first orders in tp(T^~), we obtain the approximate expression for the two-sided conditional probability 
function: 

N N 



P(oi = l\T-,T+) ~ o(l + (1 -o)( £ ^(a l+r MT- r ) - £ VK+rM^ r ))) . (16) 
Here we introduce a new function yj, 



r=0 r=0 
ai — 1 ai—0 



^) = ^v= ai = ° (17) 

a(l — a) I 1/a, a, = 1. 

The two-sided conditional probability function of the chain under consideration is given by Eq. (4). So, finally, we 
obtain 

N N 



]T TP(a i+r )<p(Tr +r ) - J2 ip(a i+r MTr +r ) 



r=0 r=0 
ai—1 ai—0 



N 



~ W\~~dS £ ( G ^ ai +r " S ) + G (" r )(Oi-r - a)). (18) 
V J r —i 

Calculating the difference between two expressions presented by Eq. (18) written for a i+ N = 1 and a»+jv = 0, we get 

v(Wlo,=i v(Wl Oi=0 - <W ( 19 ) 
Substitution of Eq. (19) in Eq. (18) yields, 

N-1 N-1 

J2 i>(a i+r MTr +r ) - ip(a i+r MTr +r ) 

r=0 r=0 
ai—1 ai—0 

- _ (1 _ rr ( ( G ( r )( a i+r + G(-r)(a^ r - a)) + G(-N)(a^ N - a)). (20) 

V J r—l 

Now we repeat this procedure N—l times. At the first repeat we calculate the difference between two expressions (20) 
written for a,i + N-i = 1 and ai + Ar_i = and substitute the obtained result in Eq. (20), and so on. At the last repeat 
we obtain, 

N 

^Tn^Gi-r^-r-a). (21) 
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So the one-sided conditional probability function is 

N 

P(oi = l\Tr) ~ a + G{-r){ ai _ r - a). (22) 

r=l 

As it follows from previous Subsection, Markov chains with such conditional probability functions are isotropic. Thus, 
we have found that the additive weakly correlated two-sided chain is asymptotically isotropic. In other words, the 
memory function of additive weakly correlated chain can be only even, G(—r) = G(r). 

IV. CONCLUSION 

Thus, using the equivalence of the Markov and two-sided chains, we studied the important property of the Markov 
chains, their isotropy. The results of this study are shown in the scheme. Here, A — st— > B means, that the chains 
from class A, restricted by the statement st, are the members of class B. The most evident fact is that the Markov 
chains, that possess symmetric two-sided conditional probability function, are isotropic. Another important class of 
the isotropic Markov chains are the sequences with the permutative conditional probability functions. One of the 
examples of such chains are the additive Markov chains with the step-wise memory functions, examined in details 
in Refs. [19, 22]. The additive weakly correlated chains are also isotropic. Such chains play a key role in the non- 
extensive thermodynamics of Ising chains of classical spins with long-range interaction, as well as in the literary texts 
and sequences of nucleotides in DNA molecules. 

Markov < Two — sided 




Isotropic 
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